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Virtually random and on-demand access is provided to a virtually 
unlimited number of subscribers by partitioning the ^ideo^p^ 
int an onlered sequence of n segments and piovidmg s^bscnbere 
concunent access to each of the n subsequences. A daa strwm 
rcprcsenutive of the video program is positioned mto " /"^sequences 
«ih reprtsenuitive of one of the n segments. The 
the n subsequences is organized as otdertd sequence of el**"*"^ 
The elemenS of each of the n subsequences are mterieaved and the 
interleaved dao stream is continuously transmitted over a video program 
Sstribution medium at a rate which *".:?f*^J*P^2'Zri 
sesment concunenay available to any subscriber having a receiver 
«ff of Meeting, ^assembling, and displaying the data of a p^ucalax 
seLent -me date stream can be compressed prior to interteaving usmg 
^frf many known video data compression sundards and techniques, 
^ta comp^«sion can be perforaied in realtime. <^ "f*"* 
software. The interleaved data stream can be transmitted m real ume. 
^Tc^ be stored on a storage devicesuch as a hard *sk 
f r later retrieval and transmission. The mterieaved date stream can be 
ordered using any known standard by which video data is transmitted 
T^ So^txLo^ and dispUy by a receiver. Data can be .nsened mto 
the interleaved data soeam to inform the receiver to which of the n 
«™enL a pTrtion f the interteaved data stream belongs, as well as the 
enMding level necessary for decompression of the <i>« .'>n^**""^ 
to indicate nJcr f display. Thus, the receiver may be^ reconstruction 
^ the beginning of the video program by 
decompressing and dispUying the date makmg ^ ^I^J't^^^ 
during a first c mplett transmission f the mterieaved date stream, arrf 
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METHOD AND APPARATUS FOR ENCODING AND FORMATTING 
DATA REPRESENTING A VIDEO PROGRAM TO PROVIDE 
MULTIPLE OVERLAPPING PRESENTATIONS OF THE VIDEO 

PROGRAM 



5 BACKGROUND OF THE INVENTION 

1. Fi^'^ nf '"ventio" 

The present invention relates to the provision of video programming on- 
demand, and more particularly to a method and apparatus that encodes, formats, 
stores and retrieves data represeming a video program as a plurality of concurrent, 
10 overlapping presenutions of the video program to faciliute virtual on-demand access 

to a single copy of the video program by virtually any number of subscribing 
viewers. 

2. ptf^p-tption pf thf Related Art 

People in the United States spend roughly $7.5 bUlion annually to rent movies 
15 and other pre-recorded video programming for private playback at their convenience. 

Such video programming can be rented in many forms, such as video cassette tapes 
for playback using a video cassette recorder (VCR), video disks for playback on 
video disk players, or as CD ROM's for playback using personal computers and other 
forms of CD ROM players. 
20 Renting video programming in this manner is desirable because it permits the 

user to view the programming at any time and in any manner. For example, the user 
may view some portion of the program at ont lime and the remainder of the program 
at some different time. Further, the user may replay certain portions of the program 
or view the program in its emirety several times. The user may access the program 
25 from any point in the program by simply fast-forwarding or revenjing through the 

program. The user is thereby ;freed from the constraints of available network or 
cable television progranuning. 

Cable television and direct broadcast satellite (DBS) companies would like to 
compete in this arena by providing users with the same freedom of use enjoyed 

30 through video rental. This service would be known as "video-on-demand.- Such 

companies would clearly enjoy an advanuge over video remal establishments in 
providing such a service because users would not be required to leave the comfort of 
their own homes to rem a copy of the video program (nor would they have to return 
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it when finished). These companies have been heretofore constrained, however, by 
existing playback and distribution technology. 

It would be prohibitively expensive for a cable television company to provide 
true video-on-demand using currently loiown technology. To duplicate the 
advantages of video rental and in-home playback, the company would have to provide 
a dedicated playback resource to each cable subscriber, along with an expensive 
memory array containing a library of video programs from which the subscriber 
could selea programs for playback through the dedicated resource. Further, the 
cable distribiitioii infrastructure would be required to have sufficient bandwidth to 
distiribut<^ a different video program, or at least a different playback of a video 
program, to each subscriber conneaed to the network. Oif course this would be 
impossible Without a leap in technology and replacemenit of the current distribution 
infrastructure. ; r > . 

One possible compromise would be to produce niulfiple. overlapping - 
playbacks (i.e. presenutions) of die same video program. sUch that a new 
presenutibri biFthe Urogram would begin, for example, every five minutes. For a 
two hour video trog^am, a total of tWenty-four overliipping presentations of the 
program would be made available to subscribers. Each subscriber would dien have a 
receiver capable of selectively receiving any one of the twenty-four presenutions. 
Although a subscriber would not enjoy full video-on-deniand. the subscriber would 
have to wait at hibst fi^^ viewin^the program in its emirety (or to 

access any point within the pfograSm). Fiiither, the wibscriber could fast-forward or 
reverse through the program by accessing a different one of the overlapping 
presentations, although he would be constrained to do so over the five minute 
intervals. 

Although such a compromise would decrease both the requisite number of 
playback resources and the necessary bandwidth, the costs of implementing such a 
system in currently known technblogy would still be prohibitive. For the above 
example, twenty-four playback resources would be required to produce twenty-four 
sepai-ate presentation^, each being transmitted over one of a limited number of 
channels comprising the distribution medium. Further, without sophisticated server 
technology, such a system might require twenty-four separate copies of the program. 

Complex disk-drive arrays or video servers have been recently proposed, 
each having thousands of video programs stored in their memory and each capable of 
serving up to two hundred subscribers. The cost of implementing a video-on-demand 
system for the 57 million current cable subscribers, assuming diat such advanced 



PCT/US95/I3513 

WO 96/13125 

technology could be unplementcd, would still require an estimated $20 billion in 
capital investments (about $350.00 per subscriber). Further, full implementation of a 
service based on. such proposed server technology would require that the current cable 
and telephone distribution network infrastructure be restnictiired and upgraded over 

5 the next several years at a cost of an additional $2 billion per year to increase its 

bandwidth. Implementing VGR-Hke fiinttions, such as fast-forward and reverse, 
would not only increase the complexity of the servers, but it would also impinge on 
available bandwidth because each subscriber must be able to communicate commands 
back to his or her dedicated server. Such fback channels" are not even avaUable in 

10 the context of existing DBS systems, and most existing, cable distribution systems. 

The best service that cable television and DBS companies have been able to 

offer thus far is a pay-per-view service that permits users to request (either over the 
telephone or direcUy through the cable network) an offered video program for a fee. 
The company then permits the. subscriber to receive the seleaed transmission of the 

15 video program, These services are far from video-on-demand, however, as the 

number of available programs and the number of starting tim^» for the programs are 
severely limited. Thus, the subscriber must still wait for a scheduled start time at 
which a desired program will be transmitted over the di.stribution network. Further, 
the subscriber does not have the freedom provided by an in-home playback resource 

20 such as a VCR; the program is still just passively received. 

Thus, there js a need in the art for technology that can provide virtually an 
unlimited number of viewers with virtually random access to as few as one copy of a 
video program through as few as one playback resource and that is operable with the 
existing telephone and cable distribution infrastructure. 

25 SUMMARY OF THE INVENTION 

The present invention provides a method and apparatus for encoding and 
formatting data representing a single presentation of a video program for storage and 
for transmission that simulates multiple overlapping presentations of the video 
program using a single playback resource. Put another way, the video program is 
30 transmitted as a digital data stream that has been formatted in such a way that it 

appears to a subscriber that a number of segments of the same program are being 
continuously distributed over a plurality of subchannels concurrently. By selecting 
successive segments for presentation over the receiver (e.g. by advancing the 
subchannel to which the receiver is tuned), an entire presentation of the video 
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program can be assembled. Further, the subscriber caii fast-forward or reverse 
. through the program by advancing or decrementing the selected -subchannel and thus 
receive a later or earlier segment of the program. . 

Thus, a one-hour program fonnatted in accordancrwith the present invention 
5 could be made to simulate, for example, twenty overlapping presenutions of the 

program with each presentation (i.e. program segment) being three minutes ahead of 
the previous one. A subscriber would have to wait only a Maximum of three minutes 
to begin receiving the program in its entirety (i.e: untU the segments begin again) 
and would be able to fast forward or reverse through the program at three-minute 
10 intervals. TTius. the maximum delay that a jSubscriber would have to experience to 

randomly access any point in the progtatt <i.e. the access time) would be three 
minutes: The present invention fesides in its ability to provide this functionality with 
a single playback resource producing a single formatted data stream that represents a 
single presenution of the video program. ! 
15 ^* «^*"-'"*>«'» 'n*»^ a«-that'a video pit>gram can 

data stream for purposes of transmitting the program over a digital distribution 
medium to subscribers: Video programs are typically organized as a series of scenes 
or frames, each frame comprising a two^imensibnal array of picture elements or 
pixels. Each pixel has characteristics such as color and brightness which can be 
20 quantified as binary data. Audio information associated with the video program can 

invention; the image and audio pbrtioiis of a vsdeo program are converted to digital 
data streams using, known techniques and standards. 

It is also well-khown that much of the iiiformation conuined in a video 
25.: program is redundant (i.e. pixels in certain regions of the pixel matrix may not 

change over considerable numbers of frames). Further, areas where changes occur 
rapidly can often tolerate artifacts that result from truncation of data representing 
pixel characteristics. Accordingly, the binary data generated to represent a video 
program can often be compressed c6nsiderabiy,^thereby minimizing requisite memory 
30 storage and transmission bandwidth. Thus, the video dau streams are preferably 

compressed (i.e encoded). using any known video data compression technique to 
produce compressed video data streams. Tlie binary data comprising these data 
streams Cooth before and after compression) are grouped into arbitrary units called 
elements; an element can refer to one or more bits of video data where video data 
35 refers to all data required to represent a video program, compressed or not. and 

including but not limited to image, audio and other associated information. 
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. The video data screams (compressed or not) are partitioned into n 
subsequences of elements representing segments of the video program, with each 
segmem comprising ^ ordered sequence of m elements. The ordered sequence of 
elements making up each subsequence are interleaved to produce a single interleaved 
5 data stream that preferably begins with the first element of each of the n segments, 

then the second element of each segment and so on in segment order until it ends 
with the m'th element of .the n'th segment. This interleaved data stream is 
continuously transmitted over the distribution medium from beginning to end. 

A subscriber with an appropriate receiver can reconstruct the entire program, 
10 staniiig when the transmission is at the beginning of the interleaved data stream, by 

sequentially selecting and .assembling the m elements of the first segment as the 
receiver serially parses through the interleaved dau stream. The receiver reconverts 
the selected and assembled elements back into image asid/or audio in real time for 
presenution of the first segment to the subscriber. As transmission of the interleaved 
15 data stream begins again, the receiver selects and assembles all of the elements of the 

second segment; for reconstruction, and repeats this process until it completes its n'^h 
pass through the data stream to select and assemble the m elements comprising the. 
n'th segment. The receiver continuously decompres.^es (i.e.. decodes) and reconverts, 
the assembled segments in real time to reconstruct the video program in segment 
20 order for viewing by the subscriber. - 

As long as the rate of transmission of the interleaved dau stream is at least, 
-n" times the average data rate "r" of the individual segments, the system wUI 
operate properly. Thus, for a given value of r. the throughput of the resource used 
to transmit the interleaved dau stream defines the number of possible segments into 
25 which the program may be divided. The viewing time of one of the n segments 

defines the access time "T" of the system, which is the minimum time interval 
between accessible points in the program. Further, the time necessary to transmit the 
entire interleaved data stream once must be less than or equal to T. 

Thus, a subscriber receives access to an ordered sequence of n segments of 
30 the video program concurrently over n subchannels, which means any number of 

subscribers can be concurrently reconstructing n overlapping presentations of the 
video program, each presentation running ahead of its predecessor by an amount of 
time T required to reconstruct one video segmem. The formatting of the dau stream 
representing the video program operates analogously to the process of time^ivision 
35 multiplexing information received from a plurality of communications channels. In 

the context of communications, however, each channef. carries a different 

-5- 
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conversation or program, whereas the present invention exploits similar principles to 
break up and transmit a single program over separate subchannels of the same 
channel. It is this unique application of TDM principles to the cotitext of 
video-on-demand which forms the basis for tii^ instant invention. 
5 An alternate preferred embodiment of the invention adapts the idea of 

statistical encoding to the interleaving process so that video segments that require 
more data to maintain desired picture quality are allocated more data while other 
segments of the program requiring less data are allocated less data such that the 
overall allocated bandwidth remains the same. In' this embodimem, the video dau 
streams are partitioned into subsequences representative of the segments first and then 
each subsequence is compressed and interleaved through k statistical multiplexer. 
This embodiment, although more complex in implementation; provides more uniform 
picture quality throughout the program: 

In the preferred embodiment of ihe invention/ the compression and 
interleaving processes are pferfofmed' iMeraciively thrbugh a combination of software 
and hardware, and the r^uitViig eiiaxied and formatted (^.^. interleaved) data stream 
represeming the program is intermediately stored on a disk or some other form of 
mass stbrage: --nie iiit^leaved dau stream can then be sequentially retrieved and 
cyclically irarismined over the distribution medium to subscribers by some relatively 
20 simple embodiment 6f a Video Server. 

therefbi¥ aiir'b^jMtive of tiie present invention to provide services which 
approximate vided-on^emand to cable television and direct broadcast satellite 
subscribers while minimizing the requisite playback resources and minimizing the 
requisite bandwidth to remain compatible with the existing distributional 
25 infrastructure. 

^^ 's ^^'^sf an objeaive of the present invention to format a video data 
stream representative of a single presenutioff of a video program such that multiple 
overlapping presentations of the video proi^ram cari be reconstructed from the 
repeated tfansmission of the formatted dau stream by a virtually unlimited number of 
30 subscribers. " 

It is sUll further an objective of the present invention to provide subscribers 
with the abUity to selectively access and reconstrua any one of n segments of the 
video program such that a subscriber may fast forward or reverse through the 
program between segments such as with a VCR. 
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It is still ftirther an objective of the present invention to use statistical 
techniques in encoding and fo^aning the data stream to minimize any variation in 
picture quality throughout the presentation of the video program. 

These and other advantages of the present invention wUl be appreciated in 
5 view of the following detailed description and the figures referenced therein. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates the interleaving and de-interleaving of a dau stream 

representative of a video program. . • ; , 

Figure 2 is a block diagram illustrating a first preferred embodiment of the 

10 invention. 

Figure 3 is a data structure diagram illustrating an interleaved sequence of 

elements formed by the systwn of Figure 2. 

Figure 4 is a diagram illustrating a possible layout of video data 
representative of a program as formatted and stored on a mass storage device by the 
15 first preferred embodiment of the invention. 

Figure 5 is a block diagram illustrating a second preferred embodiment of the 
invenuon that employs statistical encoding and interleaving. 

Figure 6 is a diagram illustrating the statistical encoding and interleaving of 
video data according to the second preferred embodiment of the invention. 
20 Figure 7 illustrates, in more detail, the sutistical encoding and interl?^^^ 

process as performed by the se<^nd preferred embodiment of the invention. 

Figure 8 is a block diagram showing an encoder of the second preferred 
embodiment of the invention in greater detail. 

Figure 9 is block diagram Ulustrating a possible layout for mass storage of a 
25 sequence of elements as statistically CTCoded and formatted by the second 

embodiment of the invemion. 

DETAILED DESCRIPTION OF THE INVENTION 

As previously discussed, one way. to closely approximate video-on-demand is 
to provide subscribers with access to multiple overlapping presentations of the same 
30 video program. The greater the number of overlapping presenutions avaiUMe to a 

subscriber, the more starting times there will be and the closer the approximation to 
complete random access of the video program. Complete random access might be 
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achieved using this scheme if the number of overlapping presentations is made, for 
example, equal to the number of frames in the video prograin. As a practical maner. 
however, the number of overlapping presentations does not have to be nearly that 
numerous. As previously discussed, however, even a satisfactory approximation of 
5 random access to a video program using this technique would be prohibitively 

expensive using known or even envisioned technology. 

The present invention resides in a unique application of time-division 
multiplexing principles (TDM) to provide subscribers with continuous access to 
multiple segments of i video program, thereby facilitating reconst^ 
10 overlapping presehtatiohs of the same video program. This functionality is 

accomplished thrdugh the repeated transmission of a single, specially formatted data 
stream representative of one complete presentation of the video program. The 
number of overlapping presentations of the video program that can be reconstructed 
from the formatted data stream, and thus the minimum access time between points in 
15 the program, is directly related to the rate at which the data stream can be transmitted 

over the distfibution nei^brk as will as the rate at which data must be received by 
the receiver to permit real-time reconstruction of the video segments at the desired 
level of picture quality. ' 

The present invention is unique because TDM principles are typically applied 
20 where a number of distinct data streams, each representing a different conversation or 

P^°8^' such that all of the 

conversations or programs are simultaneously accKsible by a receiver. The present 
invention, however, applies these principliss to transmit n different segments of the 
same program over li different subchannels of the same channel, thus making each 
25 segment of the video program simultaneously accessible to a subscriber's receiver 

over the same channel of the distribution network. The receiver can therefore be 
made to reconstruct and present any of the n segments to the subscriber by selecting 
the subchannel carrying the desired segment. 

The following detailed description is made with reference to Figures 1-9. in 
30 which like reference numerals indicate identical elements throughout all of the 

Figures. Figtire 1 illustrates the essential principles of the instant invention. 

A video program is typically organized as an ordered sequence of scenes or 
frames, with each frame defmed by a two-dimensional array of picture elements or 
pixels. A pixel has charaaeristics of color and intensity of illumination which, when 
35 combined with other pixels, creates an image or frame. For a given frame, the 

charaaeristics of each pixel can be represented digitally. Thus, it is well known in 
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the art that a video program can be converted into a digital data stream 10 that is an 
ordered sequence of bits which describes pixel values for each pixel of the aray 
during each frame of the video program. It is also known that audio associaed with 
the program can also be converted to digital dau, and can be identifjed with the 
5 image data on a frame-by-frame basis. 

Thus, a video program is first converted to a digital dau stream 10 in 
accordance with well-known standards and procedures. The data stream 10 can 
represent images, audio or both, although in the preferred embodiment, separate data 
streams 10 are produced for the image and audio portions of the program. It will be 

10 assumed for ease of discussion and illustration that the dato stream 10 throughout the 
Figures represents the image portion of the video prograin, although audio dau 
streams can be processed in accordance with the present invention as described for 
image dau. 

The dau sueam 10 is typically organized into an ordered sequence of 
15 elements, where as previously defined, an element is an arbitrary quantum of dau 

that can be one bit, the number of bits representative of a single pixel, or the number 
of bits representative of one or more frames of pixels. In the case of audio, an 
element can be from one to several bits of audio daU. 

The video program is then divided into a nutpber of video segments n, of 
20 approximately equal duration. Preferably, as many segments as possible given the 

rate at which the receiver roust receive dau to present the program in real time, and 
the maximum transmission rate which the playback and distribution resources are 
capable of sustaining. The segments are created by partitioning the dau stream 10 
into n ordered subsequences of m elements, each subsequence represenutive of one of 
25 the n segments of the video program. Thus, the video program, as represented by 

dau stream 10, starts at the beginning of the sequence of elements (i.e., the first 
elemem of segment 1 as denoted by reference numer^M 12), and ends with the last 
element of segment n (i.e., denoted by reference numeral 16). 

In the preferred embodiment, the elements of each segment are interleaved to 
30 produce an interleaved sequence of elements called an interleaved dau stream 18 as 

shown in Fig. 1. The interleaved dau stream is construtted by arranging into frames 
identically numbered elements of each segment in segment order, beginning with the 
first element of each segment, and ending with the m'th element of each segment. 

Thus, the n video segments which make up the video program are essentially 
35 time^ivision multiplexed over n "subchannels" of the channel over which the video 

-9- 
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program is broadcast. IHe interleaved data stream 18 is organized into a series of m 
"frames- 13, with each frame partitioned into n "time slots" in Segment order (i.e. 
one ume slot is assigned to each segment). During each frame, one element 
belonging to each segment is transiiiittea during the time sl6t assigned to diat 
segment. -v ■•• 

The interleaved dau stream 18 is repeatedly transmitted over a single channel 
of the television cable to subscribers. Provided that the transmission rate of the 
interleaved dau stream 18 is at least n times the average ditta rate r of the individual 
segments, it wUl appear as though all n segments of the program are available to the 
receiver simultaneously: Each new transmission of the interleaved data stream 1 8 
provides a subscriber ah opportunity to begin restoration of the video program from 
its beginning, or to cominue restoratiort of the program initiated during previous 
transmissions of the interleaved data stream. 

The subscriber can view the program from its very beginning by simply . 
prbgnumning the receiver to select and reconstnia elements associated with 
segment 1 (i.e. the first ^subchannel -) when transmission of the interleaved data 
stream is at the !>egiiiung of the interleaved data stream 18 (i.e at time tl). As the 
interleaved data stream 18 is transmitted, the subscriber's receiver selects and 
assembles (i.e. de-interleaves or demultiplexes) the elements which form the first 
segment 14. Concurrently; the receiver converts the elements coinprising segment 1 
imor a presentation bfWsegm^t for viewixSVdi^ 

of the next trahsmisiibn of (br pass through) the interlMved data stream 18 (i.e. at 
time t2). the receiver is altered (i:e: is ttihed) to the next subchannel to selea and 
assemble the elements representative of the second seginent 15! Meanwhile, another 
subscriber can simultaneously begin accessing the program by seleaing and 
assembling data representing the first (or any other) segment 17. This process 
continues for the first subscriber until the receiver has received and reconstructed all 
n segments of the video program, or umil the subscriber manually alters the 
subbhannel to which the receiver is tuned. Reconstruction will cominue from the 
newly selected segment. 

Thus; virtually any number of subscribers can simultaneously access any of 
the n segments, all of which are accessible from the transmission of a single data 
stream representative of a single presentation of the video program. Accordingly, the 
invention achieves the significantly important result of providing multiple subscribers 
virtually random access to a video program while minimizing the storage and 
distribution infrastructure necessary to provide this access. 
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As previously discussed, a subscribw can begin accessing and reconstruaing 
the program from any segment, even at a time when the uansmission is currently in 
the middle of the interleaved data stream 18 and therefore in the middle of each of 
the n segments. A subscriber can fast forward or reverse through the program by 
5 advancing or decrementing the segment currently being selerted by the subscriber's 

receiver. Such steps forward or backward in the program are, however, constrained 
to multiples of the access time T. The granularity of access points in the video 
program is a dirert funaion of the number of video segments into which the video 
program has been divided. The greater the^purabisr of video seginents n, the shorter 
10 their duration and thus the finer the steps between them Thus, n is referred to as the 

"interleaving fartor. " As previously discussed, the number of video segments into 
which a program can be divided is limited by the bandwidth available for transmitting 
the n interleaved segments and the maximum dau rate that can be susuined by the 
playback resource. 

j5 One way to reduce the data rate that must be sustained by the playback 

resource for a given interleaving factor is to reduce the total anaoiint of dau necessary 
to adequately represent the video program. Welljknqwn; techniques in the an can be 
used to encode the dau stream 10, of Figure ,1 to compress the amount of dau 
necessary to adequately represent the program. Two examples of well-known digital 
20 compression standards for video dau are the MPEG-1 and MPEG-2 standards for 

Generic Coding of Moving Pictures and Associated Audio. The ITU-T amematiohal 
Telecommunications Union Telecommunications Standardization Seaor) Draft . 
Recommendation H. 262 (10:18 Friday 25 March.1994) is incorporated herein by this 
reference. A further benefit of dau compression is that the amount of storage space 
25 necessary to store interleaved dau streams 1 8 representative of video programs for 

later transmission is also reduced. 

A first preferred embodiment of the present invention will be described which 
compresses the video dau stream 10 and then interleaves the resulting compressed 
dau elements. . A second preferred embodiment employs the principles of statistical 
30 multiplexing to sutistically encode and interleave the video dau stream 10 to ensure a 

more uniform picture quality for the reconstructed video program as viewed by a 
subscriber. Nonsutistical encoding and interleaving may be simpler to implement 
with existing encoder and decoder products and can be easily applied to independently 
compressed video dau streams. Sutistical encoding and interleaving may result in 
35 significantly improved uniformity of picture quality, but may require more 

sophisticated encoding structures than non-sutistical encoding and interleaving. 
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1. First Preferred Embodiment: Nnn.St»,|j^tical Fnrr^mp 
Interlegving 

Figure 2 illustrates a first embodiment for performing noastatistical encoding 
and interleaving according u> the invention. In Figure 2, a video program source 20 
5 provides a data stream 10 that represents, for example, the imageiwnion of the video 

program. The data stream 10, which is fypicaJly an ordered sequence of digital data 
represeijtihg pixels embodying the unages of the video program, is compressed by a 
digital encoder 22, employing any well-known procedure for coihpressing digitized 
video data. The digital encoder 22 produces a compressed video data stream 23 that 
is organized as an ordered sequence of eleniients of compressed data representing the 
video progi-am as embodied in the data stream 10. In the preferred embodiment, the 
elements are made Up of equal numbers' of bits which may hot be organized based on 
' pixel boundaries. 

The compressed video data stream 23 is then partitioned into n multi-element 
15 Subsequences of elements; each representative of one of n video segments. The 

elements of -the n subsequences are then interleaved by a partition and interleaving 
circuit 24 in acebfdahcfe with the ihethod of the inventibn as previously described. 

The panitioh and interleaving circuit 24 produces an interleaved data stream 25 diat 
can be directly transmitted to subscribers or that can be stored on a mass data storage 

20 medium 27 by dau storage unit 26 for futiire retrieval' and transmission. Data 

storage maium 27 riiSy coiB^^^^^ electronic 
memory devices. •-'-■'"">■ 

a preferred embodimeiit of the invention, ihe interleaved data stream 25 
will typically be stored oh data storage device 27 for future playbacks of the video 

25 program embodied iri the interleaved dstta stream 25. The data storage device 27 is 

placed in a system that provides on-demand video programming including a 
server 31, and a plurality of receivers 32, 34 thatare coupled to the server 31 by an 
appropriate distribution network 35. The server repeatedly transmits the interleaved 
sequeiice of elements stored oh the data storage device 27 to all receivers on the 

30 distribution network 35. Each of the receivers 32. 34 includes the processing 

capacity necessiry to reconstnio the video program in die manner described above by 
selectmg, for each video segment, the sequence of. elements comprising that segment. 
In this regard, each receiver includes the processing capacity to de-interleave the 
interleaved data stream 25, to reassemble and decode the resulting compressed data 

35 stream and to reconvert the resulting decompressed data stream 10 back into the 

sequence of pixels that embodies the images of the video program. 
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Figure 3 illustrates the partitioning of the compressed data stream 23 into 
subsequences representing the video segments. As the sequence of elements is 
encoded (i.e. compressed) by the digital encoder 22. the resulting compressed data 
stream 23 is produced as Ulustraed in Figure 2. The compressed data stream 23 is 
.5 then partitioned by the partition and interleaving circuit 24 into n ordered 

subsubsequences of elements each representative of one of n video segments. Each 
subsequence is further partitioned into m elements so that the v>tal number of video 
program elements is n m, and each element is denoted by Sij, where 1 S i ^ n and 
1 ^ '} m. As Figure 3 illustrates, partitioning reiiders the compressed data 
10 stream 23 into an ordered sequence of n subsequetices, Mch subsequence including 

one or more elements, each element including one or more bits of compressed video 
data. Figure 3 also illustrates the interleaved data stream 25 which results from the 
interleaving process. Figure 4 illustrates the storage of the interleaved sequence of 
elements comprising the interleaved data stream 25 on dau storage device 27. 
15 Referring once again .to the interleaved data stream 25 shown in Figures 3 

and 4, and to the combination for storage and formatting Ulustrated in Figure 2, it 
should be evident that one or more data storage devices 27 can be employed to store 
the interleaved data stream 25. The required aunibsr of data storage devices may be 
determined by design considerations taking into account the size of the compressed bit 
20 stream 23, the interleaving factor n, and the access speed and capacity of individu^ 

data storage devices. Assuming that the dats^jstorage device is a hard disk drive, the 
interleaved sequence 25 can be split into different, but equally-sized sections, and 
each seaion can be recorded onto one of N, different hard disks. The capacity of 
each dau storage device 27 is assumed to be sufficient to contain nm/N^ elements. A 
25 moredeuiled discussion of those considerations will be presented below. 

2. gyf ^nd Preferre t' f "^hft«itm<»w( the Invention; 

< ; ^ntistigfll Fjacodiiig «nd Interleaving 
Figure 5 illustrates a second preferred embodiment of the invention which 
performs statistical encoding and interleaving. A video progr^ source 60 provides a 
30 data stream 10 representative of a sequence of pixels that embodies the image portion 

of the vid«) program. The data stream 10 is organized as an ordered sequence of 
elements, each element comprising data representing an equal number of pixels. The 
video program is partitioned into n segments, with each video segment represented by 
a subsequence of data stream 10, each subsequence representative of an equal number 
35 of pixels. 
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The n subsequences representative of the n video seginents are aligned in time 
by the panition and alignment circuit 62 and each subsequence is concurrently 
provided on a signal line 63 to a respeaive digital encoder 64. Each digital encoder 
converts its respeaiVe subsequence into a compress^ subsequence of elements, each 
5 element consisting of one or more bits of compressed video data; Dements of the 

compressed video data stream 65 are interltiaved by an interleaving circuit 66 to 
produce an interleaved data stream 67. In the preferred embodiment, a data storage 
unit 68 receives the interleaved data stream 67 and transfers it to a data storage 
device 70 for later retrievaJ and transmission. As previously disciissed, the 
interleaved d;ita stiream 67 can also be transmitted immediaiely to subscribers over a 
distribution network in ireaftilhe. 

For playback of the video program embodied in the interleaved sequence of 
elements 67. data storage device 70 is placed in a system that provides onnJemand 
video programming. The system preferably includes a server 72, and a plural ityjjf 
receivers 73. 74 that are coupled to the serVer 72 by an appropriate distribution 
network 75; The server rep'^tedly transmits the interleaved data stream 67 stored on 
the data storage device 76- & all receivers connected to the distribution network 75. 
The interleaved data Stream 67 is repeatedly transmitted to all receivers. Each of the 
receivers 73, 74 iribludes the processing capacity necessary to reconstma the video 
program by selecting and assembling, for each Video segment, the subsequence of 
elements reprSsentadve of the segment. In this regard, eich receiver includes the 
processing capacity' to a^imerleive (iJe. demultiplex) the interleaved data stream 67 
to thereby reproduce compressed dsia stream 65, to decode compressed data stream 
65 into data stream 10, and to conven the data stream 10 to the sequence of pixels 
that embody the video program. 

A more detailed discussion df the statistical encoding and interleaving process 
performed by the combination illustrated iii Figure 5 is now presented with reference 
to Figures '6 and 7. The data stream 10, whiih is a digitized represenution of the 
sequence of pixels embodying the images of the video program, is panitioned into n 
subsequences of elements representative of o video segments. Each element of the 
subsequence consists of data that represents the same number of pixels. Each 
subisequence has an equal number bf elements and therefore represents the same 
number of total pixels. 

Each pixel of the subsequence representing the first segment 84 of partitioned 
dau stream 80 has a video intensity value s(t), where each pixel is defined by its 
position in the subsequence as a function of time. Because the duration of a segment 
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is defined to be T, the video intensity value for each pixel of the second subsequence 
representing the second segment 86 is defined by s(t + T). and for all pixels is 
defined by s(t + i - T) were O ^ i < n. Each of the subsequences of partitioned 
data str«?am 80 are then separately assembled and input to their respeaive decoders 
5 siTOMltaneously as shown in Figures 6 and 7. Thus, the segments are time shifted for 

purposes of concurrent processing. 

Each encoder 64 of Figure 7 processes its own subsequence of digital pixel 
data and the preferred embodiment of such an encoder is shown in more detaU in 
Figure 8. Such encoders are well known in the an and the details of the encoder 
10 disclosed are not relied on for patentability of the inyention. Those of skill in the art 

will recognize that any encoder suitable for compressing video data within the context 
of the prevent invention can be substinited therefor. 

As illustrated in Figure 6, each encoder compresses the dau comprising its 
respective subsequence of pixels, producing a sequence of elements consisting of 
15 compressed data called blocks 82. The encoder performs this function by first 

organizing its subsequence of pixel daa into dements called blocks with a blocking 
circuit 100 (Figure 8). Each block consists pf 4ata r«!pr«»enting an equal number of 
pixels. Each block represents some subset of the total number of pixels embodying 
the segment. A block can consist of data representing all of the pixels that make up a 
20 single frame or image of the segment. As an example, a frame may contain 480 lines 

of 720 pixels, or 345,600 pixels total. Blocks <an arbitrarily consist of pixels making 
up fractions of frames, single francs or even multiples of frames. 

Each element or block of pixel data is then processed through a transform 
circuit 102, wliich uses well-known compression transforms, such as the discrete 
25 cosine transform (DCT) to convert the binary pixel data to transform coefficients. 

The coefficients are quantized or normalized by adaptive quantizer 103, which 
improves coding efficiency by truncating the coefficients in accordance with the 
desired level of picture quality to be produced when the information is decompressed 
for presentation. Finally, the.quantized coefficients are passed through a statistical 
30 encoder 1 10 which further compresses the data based on a variable length encoding 

technique such as Huffman coding. 

Each of the encoders is synchronized so that each produces a block of 
compressed data simultaneously, and each encoder is preset to a coding level that 
reflects the desired quality level of the reproduced picture. Each compressed block 
35 (i.e. element) of data produced by an encoder, although still representative of an 

equal number of pixels, may vary in its amount of binary data because some blocks 
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of digital pixel data will compress more easily than others. Block multiplexer 66 
(Figure 7) then interleaves the blocks by selecting a block from the first encoder (and 
thus from the first segment), then the second and so on, up to encoder n, and then 
repeats the process for the next set of compressed blocks: Thus, an interleaved data 
5 stream 94 is produced as shown in Figure 6, with each block 82 designated first by a 

segment number and then by block (i.e. element) numb^. 

The interleaved data stream 94 is then input to a first-in-first-out (FIFO) 
cbamiel buffer 92 (Figure 7) and clocked out of the buffer at the transmission rate 
necessary for proper operation (i.e. n -r). if the buffer begins to fill up. a signal is 
provided over line 93 (Figure 7) which instnicts each of the adaptive quantizers 103 

(Figure S) in each of tHie ieni^ers 64 (Figure 7) to increase the coding level which 
will increase the compression ratio' (i.e? be less accurate with respea to the 
coefficient values;) until the buffer starts to empty out. Likewise, if the buffer 
becomes too «anpty, the Channel buffer 92 Can instrua the adaptive quantizers over 
15 sigiial line 93 to decrease the coding level which will decrease the compression ratio. 

If the number of segments "n" and the channel buffer 92 are sufficiendy 
large, thai it ii scitiiticaf/probab that the number of data intensive compressed 
blocks (i.ie. those blocks whidh were difficult to compress) wUl balance out with those 
compressed blbcbr containing less information (i.e. those blocks which were more 
easily compressed) oveV any window of time. Thus, the picture quality should be 
'■*^°'»^*''y consistent tHrtiughoiif the Video program and flie number of changes in the 
compression ratiodiinrtg encoding and interleaving should be minimal. 

An exiampie of this encoding technique as applied to multiple programs being 
multiplexed over a multichannei trunk is disclosed in U.S. Patent No. 5,216.503 to 
25 Paik et i^., which is incorporated herein by this reference. In Paik et al., this 

technique is applied to ensure that the sum of the data trar.smitted at any time over all 
of the channels of a trunk does not exceed the total bandwidth of the trunk. 
Application of this technique to the instant invention is unique because it is applied to 
segments of the same program to achieve uniform picture quality during playback of 
30 the single program. 

The same encoder that is illustrated in Figure 8 can also be used in a 
nonstotistical encoding combination as in the first embodiment. In this case, each of 
the *n" encoders of Figure 7 could maintain an independent channel buffer, and the 
compression ratio of each individual encoder would be adjusted in order to maintain a 
35 pre-assigned fraaion of U»e total throughput. The disadvantage of the nonstatisucal 

system is that the encoders will tend to deliver unnecessarily high picture quality at 
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times when the video program is easily compressed, and poor picture quality during 
certain complex scenes when compression becomes difficult. 

3. A^rtj|i ftnfll I m plefnentation Details Common. Bftth mfffTgtf 
, fjnhodiments 

5 The application of video compression does not necessitate real-time digital 

encoding as implied in the first and second embodiments, nor does it require multiple 
encoders. Another preferred way of interleaving and compressing a data stteam 10 
represenutive of a video program to take advantage of the statistical variations in the 
video program is to iteratively compress and interleave the video program using an 

10 algorithm that is wholly or partly implemented in software and uses multiple encoding 

passes through the video, program. The algorithm can mpre efficiently compress the 
video program by tuning the compression algorithm during each iteration. 

An encoding process implemented in software may use a video compression 

standard such as the one iinplemented by the encoder of Fig. 8.. For the first 
15 embodiment, the software compress«!S tbedata stream 10 in accordance with a desired 

quantization level, and then measures the total amount of ^ata that results. If the 
amount of data exceeds that which can be transmitted within the specified bandwidth, 
the quantization level is increased and the data stream 10 is compressed again. TTiis 
process continye? until the resulting compr«!Ssed data stream falls within the requisite 
20 bandwidth. . Jhe software thei» partitions the qo^pressed data stream and interleaves 

the elements of the segments of , the partitipned subsequences to produce an 
interleaved data stream representative of the video program. 

Iterative compression through software is particularly advanugeous when 

statistically encoding and imerleaving because it does not require the use of costly 
25 hardware to split the ordered, sequence of pixels represented by the data stream 10 

into video segments, nor does it require multiple encoders to simultaneously compress 
each video segmem. Rather, the data stream 10 is first partitipned into subsequences 
of elements representing segments with the same number of pixels. The partitioned 
data stream is then compressed in accordance with a specified encoding level using a 
30 standard such as the one implemented by the encoder of Fig. 8. TTie software then 

interleaves the compressed elements of the subsequences in accordance with the 
invention. As the software interleaves the elements, it sums the total arooum of dau 
across the segments within a certain window, much like the channel buffer 92 of Fig. 
7. Any seaions of the interleaved data stream for whiph the amoum of data exceeds 
35 the specified bandwidth over the defined window are compressed again using a higher 
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coding level. For any seaions which exceed some minimum amount of dau, the 
program can recompress the seaion using a lower coding level/ 

One way to save some computer time would be to use a hardware encoder 
such as the one shown in Fig. 8 to (Sonipress the data streirh 10 at a number of 
different coding levels and to store the different'cbmpressed versions. The software 
can perform the steps of interleaving and summing, and for any seaion of the 
interleaved data stream that is detiscted to be sufficiently ova or under the specified 
bandwidth, the software can simply replace that seoioii witli a section of one of the 
stored interleaved dau streams that has been comprewed at the appropriate level of 
quahtizatbn. 

During each traiismis^lon of the interleaved data sti-eam, a receiver must be 
able to identify the elements of the particular video segment to be accessed, 
reconstructed and displayed. One |>ossible implementation by which this can be 
accomplished is by insening video segihent identifiers into the interleaved sequence of 
elements as they are being stored for fiitiire transmission. For example, sequence 
numbers (i.e., subchannels) ranging from 1 to n can be assigned to video segments 1 
to n respectively. Tlie appropriate sequence number can then be associated widi the 
video dati domprUing each element prior to interleaving and storage. Thus, as a 
receiver begins to reconstruct a video program from its beginning, the receiver selects 
and assembles each elemem having a sequence number of 1 during the first pass, 
followed liy the eleiiients having k sequent nu^^ second pass and 

so on. The reconiiructioii process^is compleite when all of the elements having a 
sequence number of "n" are selected during the finii pass. Of course, a subscriber 
could program the receiVer to jump ahead or backward 'in the program by manually 
programming the seleaed sequence number (i.e., by changing the subchannel). 

Another possible implementation is to program the playback resource to insert 
the video segment identification information into the interleaved sequence of elements 
as they are being trahsmitted to the receivers. For example, the same sequence 
numbers ranging firom 1 to n can be: initially assigned to video segments 1 to n 
respeaively for a first transmission. At the beginning of the next pass through the 
intisrleaved dau stream, the playback resource will decrement each segment's 
assigned sequence number such that segment number two currently has sequence 
number one assigned to it, while segtnent one currently has sequence number "n" 
assigned to it. Therefore, once the receiver begins to reconstruct the video program 
based on a particular subchannel or sequence number, it can remain uned to that 
number throughout the entire reconstruaion. 
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One disadvantage of this implementation is that the first segment, which 
always represents the beginning of the video program, is no longer associated with a 
single sequence number. Therefore, the playback resource must insert additional 
information into the interleaved data stream prior to its transmission to demarcate the 
5 . first segment of the, video program. 

Another possible implemenution would be to demultiplex the elements at the 
receiver (i.e. 32, Fig. 2 or 74 Fig. 5) synchronously, with each time slot in a frame 
assigned to a particular segment of the program. 

As previously discussed, the receiver (i.e. 32, Fig. 2 or 74 Fig. 5) also must 
10 be able to decode the compressed data and display the right pixels in the right 

sequence and at the right time. In the case of audio data, the receiver must also be 
able to synchronize the audio with the images. Finally, the receiver must know what 
the coding level of the compressed data is at all times. As previously discussed, 
there are a number of well-known standards for representing video dau digitally as 
15 well as compressing it that specify how such information be provided in the data 

stream. . -tM. . 

For example, the interleaved sequenpe of blocks comprising the interleaved 
data stream 94 (Fig. 6) as generated by the second embodiment combination shown in 
Figures 6, 7, and 8 may be packetized by a packet encoder 121 (shown in Fig. 7). 
20 As an example, the interleaved sequence of blocks 94 may be divided into groups of 

packets, with each packet in the group containing compressed video dau representing 
pixel, values for the same.sequcnce of pixels during each of the n segments. Put 
another way, each packet might be comprised of a block from each segment, each 
block containing the pixel values s(t) for corresponding pixels of frames occurring at 
25 time t, t+T, t+2T ... t+(n-l)T. 

A single packet may be organized as shown in Figure 9. It should be noted 
that, in the preferred embodiment, the size of a packet may vary because some blocks 
of video may be more difficult to compress than others. Other information included 
in a packet might be that which defines packet and block boundaries, as well as the 
30 coding level of the data in the packet. 

Another way of organizing the data is to create packets of data during the 
interleaving process, such that each packet contains some arbitrary amount of data 
froni a single subsequence rq)resenting a segment, which nwy or may not be on 
block boundaries. The packets are interleaved rather than the blocks, and in.-rmation 
35 defining the segment, the panicular pixels represented by the dau and a time stamp 

which defines a display time for the pixels defined by the dau in the packet are 
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included as a header. In tbis case, the order of interleaving is determined by 
increasing time stamp value instead of by segment number. 

As previously discussed, the required amount of storage and the necessary 
throughput of the storage device for playback of a video program depends on several 
design parameters. One of the most important parameters to be specified is the 
access time "T", which is the time duration of each video segment as it is 
reconstructed by a receiver for viewing by a subscriber. This parameter defines the 
maximiim delay that ^ subscriber miiit endure when the subscriber randomly accesses 
the program for playback from its beginning. 

Playback is a realMtime process involving continuous retrieval and 
transmission of the same ifiterleaved video data stream, aiid the continuous 
reconstruction of a" Video' program from that interleaved data stream. Because all n 
video segments are presented for access by a receiver simultaneously, it follows that 
any of the n video segments can be accessed at any time during playback. Playback 
of all video segments begins at the same time and completes at the same time. Thus, 
the access time T also defines- the inaximum delay that will be endured to access any 
point in the vidjjd lirbghm. Stated differently, it defines the minimum interval of 
time over which the program' can be randomly accessed. 

Another parameter to be specified is the average data rate "r" of the 
compressed vidiso segments of the video prograin. TTiis parameter defines the rate at 
which segment data niust be reeeived by a receiver so that it can reconsirua the video 
program in real-time att the desired level of quality. The data rae "r" is determined 
by the initial image resolution and frame rate of the video program and by the 
compression ratio that was applied during its encoding, it is expected that most 
applications of this invention will not require bener than VHS picture quality and it is 
reasonable to assume that this can be achieved if r = 1.5 Mbits/second. If statistical 
multiplexii^ is used, then the data rate of each Compressed video segment will vary 
because some data segments will compress more easily than others. As previously 
discussed, however, the cumulative data rates of all n segments wit! tend to be 
relatively constant from one program to the next. 

For a receiver to have simultaneous accfess to each segment, the rate at which 
the interleaved data stream is transmined over the distribution must be equal to the 
number of segments n times the average dau rate of one segment r (i.e. n r). Thus, 
the distribution system and the storage facility from which the interleaved data 
program is to be retrieved (or the encoding and interieaving apparatus used to 
generate the interleaved data stream if interim storage is not used), must be able to 
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sustain this data rate. One of the advantages of the present invention is that the 
cylinders and tracks of a hard disk can be accessed sequentially or in any sequence 
which maximizes the throughput performance of the unit. Sequential access is made 
possible by the fart that the playback process accesses, retrieves and transmits the 
5 same interleaved sequence of elements over and over. 

Thus, there is no random access requirement imposed on the interim storage 
unit. Assuming that a particular disk drive device can sustain a data rate of 
30 Mbits/second, if r = 1-5 Mbits/second, then n cannot exceed 20. As previously 
defined, the total duration of the video program, is n-T. Assuming that the video 
10 program is two hours in duration, the duration T of each segment is 6 minutes. The 

storage capacity required for 120 minutes of video compressed to an average data rate 
of r = 1.5 Mbits/second is therefore. 1.35 GBytes. 

In addition to compressing the data and maximizing the data rate of interim 
storage, the minimum access interval may be further reduced by splitting the 
15 interleaved data stream into equal portions, storing the portions on separate disks, and^ 

then accessing each disk concurrently to retrieve and transmit each portion of the 
interleaved data stream simultaneously. Effertively, each video segment has been 
subdivided into equal portions, with each ponion.of each segment made available to a 
receiver simultaneously over a different communications channel. 
20 For example, suppose that the interleaved data stream representative of the 

two-hour program of the previous example is divided into three equal portions, with 
each ponion stored on a separate disk. If the portions from each disk are retrieved 
and transmitted simultaneously over three separate channels, then the first one-third 
of each segment will be available on a different subchannel of the first channel, the 
25 second one-third of each segment will be available on a different subchannel of the 

second channel, and the third one-third of each segment will be available on a 
different subchannel of the third channel. The access interval thereby reduced 
from T = 6 minutes to T, = 2 minutes, where T^ = T/N^ (N, = the number of 
disks). The minimum capacity of each disk is likewise reduced to 40 minutes of 
30 video compressed to an average data rate of r = 1.5 Mbits/second, or 450 MBytes. 

It wUl be appreciated by those of skill in the art that multiple disks also may 
be used in the event that the total data comprising the interleaved data stream exceeds 
the storage capacity of a single storage device such as a disk, or if the required 
throughput of the single storage device is not sufficient to meet that specified by n r. 
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Two preferred methods of partitioning the interleaved sequence of blocJcs for 
writing on multiple disks are now described. The puipose of these methods is to 
create overlapping data streams from each disk that remain relatively constant in time 
relative to one another. Those of skill in the ah will appreciate that there are many 
possible schemes for panitioning the data which are contemplated to be within the 
scope of the present invention. 

One panitioning methdd is to split a packetized interleaved sequence of 
elements at packdt boutidaries such thiat the same number of packets are written to 
each disk. For exainpie. if iach packet contains data that is rq)resentative of a fixed 
niimbisi- of pixels, then the firist K packets niay be allocated to a first disk, the next K 
packets to a second disk, and so on. until finally the last K packets are assigned to the 
last disk. The totil humber df packets must be equal to the product of K and the 
number of disks. This partitioning method may be referred to as the "constant 
pixels" method, because all of the disks contain video data that is representative ot 
the same nuriiber df pixds. ' 

A second preferred method of splitting the packetized interleaved sequence of 
blocks for writing on multiple disks may be termed the "constant bits" method. For 
the constant bits niethoa. the same amount of compressed video data is allocated to 
each disk. The interleaved sequence of blocks 94 is divided into equal seaions, one 
for each disk, but the panitioning is not constrained to occur at a packet boundary. 
If the total amount of video dita in the mterleaved data stream is not evenly divisible 
by the number of disks to be usied; then the sequence may be extended by inserting 
fill dau at the end or at certain points where they will not affect the decoding 
process. 

Clearly, other embodiments and modifications of the present invention will 
occur readily to those of ordinary skill in the art in view of these teachings. For 
example, encoders based on other known compression techniques may be substituted 
for that disclosed in the preferred embodiment. In addition, the interleaved data 
stream could be generated and transmitted in real time without need for intennediate 
storage. The elements of the interleaved data stream can be any arbitrary amount of 
dau. the boundaries of which can be defined by any number of predefined standards. 
Therefore, this invention is to be limited only by the following claims, which include 
ail such embodiments and modifications. 
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1 . A method of providing concurrent access to an ordered sequence of a 
plurality of n segments comprising a video program, said method comprising the 
steps of: 

5 panitioning a data stream comprising an ordered sequence of data 

representative of the video program into n subsequences, each of the n subsequences 
comprising a portion of the dau stream representative of one of the n segments, the 
data of each of the n subsequences organized as an ordered sequence of elements; and 

interleaving the elements of the n subsequences to produce an interleaved data 

10 stream. 

2. The method of Claim 1 wherein the ordered sequence of elements of each of 
the n subsequences comprises a plurality of m elements. 

3. The method of Claim 2 further comprising the step of compressing the data 
stream whereby each of the m elements of each of the n subsequences comprises 

15 compressed data. 

4. The method of Claim 3 wherein each of the m elements comprises an equal 
amount of compressed data. 

5. The method of Claim 4 wherein said interleaving step further comprises the 
step of grouping the first elements of each of the d subsequences together in segment 

20 order, then likewise grouping the second through mth elements of each of the n 

subsequences. 

6. The method of Claim 1, 5 or 15 further comprising the step of repeatedly 
transmining the interleaved data stream over a video program distribution medium for 
a predetermined period of time. 

25 7. The method of Claim 1, 5 or 15 further comprising the step of storing the 

interleaved dau stream on a storage device. 
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8. Tfie method of Claim 7 further comprising the steps of: 

retrieving the interleaved dau stream from the storage device; 

transmitting the reuieved interleaved dau stream over a video program 
distribution medium; and 

5 repeating said retrieving and transmitting steps continuously for a 

predetermined period of time. 

9. the method Of claim 6 wheriein a receiver must receive the ordered sequence 
of elements of one of the n subsequences at a rate r to present the segment 
represented by the one of the n subsequences to a viewer in real time without 

10 interruption, and wherein said step of repeatedly transmitting is performed at rate 

equal to or greater than the product of n and r. 

10. The method of claim 6 wherein a receiver muit receive the ordered sequence 
of elements of one of the n subsequences at a rate r to present the segment 
represented by the one of the n subsequences to a viewer in real time without 

15 »ntenruptioh, and wherein said step of ixansmining the interleaved data stream 

performed at ratreqtfaJ^^^i^^^^^ 

11. The method of Claim 3 wherein said step of compressing the data stream is 
performed statistically. ' 

12. The mtthod of Claim 1 1 wherein the data comprising the data stream is 
20 representative of an ordered sequence of pUels comprising the video program, and 

wherein each of the m elements of each of the n subsequences comprises a portion of 
the data stream representative of an equal number of pixels. 

13. The method of Claim 12 wherein said st^ of statistically compressing further 
comprises the step of encoding each of the n subsequences in accordance with a 

25 specified compression ratio to produce n encoded subsequences of elements, each of 

the elements comprising compressed data representative of its ordered sequence of 
pixels. 
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14. The method of Claim 13 wherein said interleaving step further comprises the 
step of grouping the first elements of each of the n encoded subsequences together in 
segment order, then likewise grouping the second through mth elements of each of 
the n encoded subsequences to produce an interleaved dau stream comprising m 

S groupings of n elements. 

15. The method of Claim 14 wherein said step of statistically compressing further 
conq)ri$es the steps of: - ^ . 

summing the amount of compressed data in each of the m groupings with the 
data in a predetermined number of its preceding groupings; 

iQ increasing the specified compression ratio whenever the summed data exceeds 

a first predetermined throughput; and 

decreasing the specified compression ratio whenever the summed data falls 
below a second predetermined through put. 

16. The method of Claim 15 wherein said step of encoding each of the n 

15 subsequences is performed on each of the n subsequences concurrently and wherein 

each of the n encoded subsequences of elefnents are produced synchronously , 

17. The method of Claim I6.wherein said interleaving step, said summing step 
and said steps of increasing and decreasing the compression ratio are performed in 
real time on said n encoded subsequences of elements. 



20 



18. The method of Claim 14 wherein said step of statistically compressing fiirther 
includes the steps of: 

summing the amount of data comprising each of a plurality of portions of the 
interleaved data stream, each of the plurality of portions comprising a different one of 
the m groupings and a predetermined number of its succeeding groupings; 

25 increasing the specified compression ratio for each of the plurality of porti ns 

having a sum of data that exceeds a first predetermined throughput; 
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decreasing the specified compression ratio for each of the plurality of ponions 
having a sum of data that falls below a second predetermined throughput; and 

repeating said steps of encoding, interleaving, summing, increasing the 
specified compression ratio and decreasing the specified compression ratio untU no 
5 further increases or decreases in the specified compression ratio are required. 

19. The method of Claim 5 or 1 4 wherein the grouped elements are organized 
into packets, the packets comprising one or more of the grouped elements of the 

. interleaved data stream. ' ' 

20. The method of Claim 19 wherein the packets further comprise information to 
10 facilitate the decoding and presentation of the video program. 

21 . The method of Claim 20 further comprising the step of storing the packets on 
one or more- storage devices^' " - ■' 

■ 22. The method of Claim 21 ftirther comprising the steps of: 

partitioning the interleaved dau stream into two or more portions, each of the 
15 portions compr ising^^ eqfilal humBer of the packos; a»d ■ 

storing each of the two or more portions on a different storage device. 

23. The method of claim 22 further comprising the stq>s of: 

concurrently rorieving the two or more portions from the two or more 
■ storage devices; 

20 transmitting each of the concurrently retrieved two or more portions 

simultaneously over separate channels of a video distribution medium; and 

repealing said concurrently retrieving and said transmitting steps continuously 
for a predetermined time. 
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24. The method of claim 23 further comprising the steps of: 

concurrently retrieving the two or more ponions from the two or more 
( storage devices: 

transmitting each of the concurrently retrieved two or more portions 
5 simultaneously over separate channels of a video distribution medium; and 

repeating said concurrently retrieving and said transmitting steps continuously 
for a predetermined time. 

25. The method of claim 13 wherein said interleaving step further comprises the 
steps of: 

apponioning each of the n encoded subsequences of elements into a plurality 
of X packets, each packet comprising a portion of the compressed data comprising the 
n encoded subsequences of elements and rq)resematsve of the same number of pixels; 
and 

ordering the packets by. first selcaing and grouping the first packets from 
each of the n encoded subsequences in segment order, then likewise selecting and 
grouping the second through the xth packets. 

26. The method of claim 1 or 3 wherein said interleaving step further comprises 
the steps of: 

apportioning each of the n subsequences into an ordered sequence of a 
20 plurality of x packets, each packet comprising a portion of the data stream 

representative of an equal number of pixels; and 

ordering the packets by first selecting and grouping into segment order the 
first packet from each of the n subsequences and likewise seleaing and grouping into 
segment order the second through xth packets from each of the n subsequences. 
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27. The method of claims 1, 5, or 14 wherein said step of interleaving further 
comprises the stq>s of: 

assigning a unique segment identification number to each of the n 
subsequences; and . " 

5 iassiting data representative of the unique segment identification numbers into 

the interleaved data stream to identify to which of the n subsequences each of the 
elements belongs. 

28. The method of cliaim 8 further comprising the stq)s of: 

assigning a unique segment identification number to each of the n 
10 subsequences: and 

insening data i^resentative of the unique segment identification numbers into 
the retrieved interieav^ data stream to identify to v/hich of the n subsequences each 
of the elements belongs. 
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29. The method of claim 29 wherein the unique segment identification numbers 
indicate the sequence order of the segments comprising the video program. 

30. The method of claim 29 further comprising the stq)s of: 

for each retrieval and iraiismission of the interleavet^ data stream, inserting a 
flag to denote the one of n subsequences representative of the first segment of the 
video program; and 

decrementing the currently assigned segment identification numbers for each 
of the n subsequences upon completion of each retrieval and trarismission of the 
interleaved data stream. 
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